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(57) In an automatic reading assistance system for electronic documents (502), an automatic annotator (508) 
finds concepts of interest (512) and keywords. The operation of the annotator is personalizable (518) for a 
particular user. The annotator is also capable of improving its performance over time by both automatic and 
manual feedback. Another available feature is a thumbnail image of all or part of a multi-page document 
wherein a currently displayed section of the document is highlighted in the thumbnail image. Movement of the 
highlighted area in the thumbnail image is then synchronized with scrolling through the document. 



504 



506 



508 



IE 



DOC 
BROWSER 



Profile 
%\%<S Editor 



ANNOTATION 
AGENT 



514 



Output Formatted 
TextFUe 



| formatting] 



stz 



Output: Annotated 
Text Stream 



CONTENT RECOGNITION] 



™h 

| TEXT PROCESSING | 



Output: Parsed 
Text Stream 



516 



USER 
PROFILE 



WW ™ 
< /TOCUMEm\ u 



Raw Text Input 
(e.g. from internet or OCR'ed documents) 

S02 



Fig. 5 



o 

CD 

CO 
GO 

ro 



At least one drawing originally filed was informal and the print reproduced here is taken from a later filed formal copy. 
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of rubstanlaJ complexity be integrated within a larger system context ? By requiring Oat all interactions with the 
legacy database be mediated by the agent, we have been abb to isolate the database system ckanly while stiD 
supporting query- free information retrieval. OOA OOH 

220 zzo /m 

FOOT is comprised of the three subsystems already mentioned: the probabilistic {expert's yi tern} the legacy 
fufl-tcxt datable sy stem (to which we added a rjtvt, semarUicaay^ased, indexing structure that supports limited 
C55 language queries), and thef"*^ **~ 



hat effectively integrates them . The following sections 



describe these system components, provide implementation details, illustrate the runtime behavior of FIXIT, 
report on operational experience, and close with some observations about query- free information retneval and 
the potential for generalizing the underlying paradigm. 

-222 

HXTFs System Components 

We first descrfce the probabilistic expert sub-system and the mformat ion retrieval sub-system Before briefly 
describing these, we stress that our purpose was not necessarily to advance the capabilities of the individual 
components or indeed even to exploit fully the best current technology; instead, we focus on their integration. 

990 

Expert System Component . ^ 

For our purely diagnostic applications, we elected to use the Relief net t or Bayesian net) representation that has 
recerved considerable attention in recent years 1 . 

Belief networks use conditional probabilities of the for m p (aj If x) to repr esent associations between a fault 
fi and an observable symptom sj that it may produce. A (knowledge base f or a Relief net expert system p onsrst 
principally of a collection of conditional probabilities of this form V J 

x 22(r 

The relations among faults and symptoms are conveniently represented as a directed acyclic graph as shown in 
Figure 1. 
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^—1002 

<RB.ANOH.S NUMBERS >-' 
1006 We approached this challenge by incrc^ducirfe an 

^<RH.JkNOH CONCEPTs:*Xntelligettt J^ents* S0BCONCEljr=" intelligent agent'" SEN- 
TENCE- NOMBER=a> intelligent agent/<V RH . ANOR> that analyzes interactions 
between user and<RH • ANOS TONCEPT-*BaY«a Inference* SUBCQNCEPT** expert system" 
sentence^"*" NUMBER^ 3 > expert »y»t-m^</RH.AHOH> and automatically constructs 
database Queries based on trhxs enalysis</RH.ANOH.S> . The user is unobtrusively 
notified when xnronnation relevant to the current i diagnostic context has been 
returned, and may immediately access it if desirecL From the user's perspec- 
tive all database machinery is entirely transparent; indeed no formal query 
language is even made available. Hence we term this approach query-free infor- 
mation retrieval. <p> . AA . 

.1002 100a 

<RB.ANOH.S NUMBER— 5 >- / IW *- \ 

1006 As we hope will be apparent from what follows, tne introduction of the 

^<RH.AHOH CONCEPT-*Xntelligent Agents* SUBCONCEPTW* intelligent agent* SEN- 
TENCE- "5" number* 2 > intelli gent agent </EH, ANOH>' additionally offers one solu- 
tion to a fundamental problem facing designers of cooperative information 
systems: How can legacy systems of substantial complexity be integrated within 
a larger system context </rh.anoh.s>2 By retiring that all interactions with 
the legacy database be mediated by one agent, we have been able to isolate the 
database system cleanly while still Supporting query- free information 
retrieval . <p> \ 

^1002 1004 1008 

<RH.ANOH.S NUMBER— 6 > / / 

ififiA FrxIT is comprised of the three subsystems alreaftur mentioned: the probabilistic 
lUUO^ <kh - ANOH CONCSPT«*B*yes Inference* SUBCOBCEPT^* Aacpext system* SEN T ENCE ** 6* 



NUUBER-Oexpert system </RH.ANOH>, the legae^ fill-text database system (to ^006 



which we added a new, semantically-based^lndexlng structure that supports lim- 
ited <RH.ANOB CONCEPT— *Katural XAnguag^* SUBCOMCEPT»* natural language* 
tzncz«*6* NUKBER-l>natuxal language >^/RH-ANOH> queries) , and the <RH.AKOB CON- 
CEPT- -Intelligent Agents* SUB CONCEPT -* intelligent agent 0 SENTENCE-* 6* NUM- 
BERS 3 > int e 11 i gent agent </RH.ANOH> cnat effectively integrates 
them< RH . anoh . s> . The following sections describe these system components, pro- 
1004 Viae implementation details, illustrate the runtime behavior of FXXXT* report 
on operational experience, and close with some observations about query- free 
information retrieval and the potential for generalizing the underlying para- 
digm. <p> 



<h2> FIXIT's System Components < /h2> 

We first describe the probabilistic expert sub-system and the information 
retrieval sub-system. Before briefly describing these, we stress that our pur- 
pose was not necessarily to advance the capabilities of the individual compo- 
nents or indeed even to exploit fully the best current technology; instead, we 
focus on their integration. <p> 
<P> 
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